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On the Asymptotic Joint Normality of Quantiles From a 

Multivariate Distribution 1 

Lionel Weiss 2 
(December 18, 1963) 

A simple proof is given of the asymptotic joint normality of sample quantiles from a multivariate 
population, under very mild conditions. The joint cumulative distribution function, of the quantiles is 
studied, rather than the joint probability density function. 



1. Introduction 

Suppose Xi, . . . ,Xk are jointly distributed random 
variables, with absolutely continuous cumulative dis- 
tribution function F{%\, . . .,#*). Fi(xi) and fi(xi) 
denote respectively the marginal cumulative distribu- 
tion function and marginal density function for Xi. 
Fjj(xi, Xj) denotes the joint marginal cumulative distri- 
bution function for Xu Xj. 

Let 6i, . . ., 6/ v be fixed quantities, each in the open 
interval (0, 1). Suppose n independent observations 
are taken on the vector (Xi, . . ., Xu). Denote by 
Yi{n) the 6,th sample quantile of the n observed values 
of Xi. That is, Yi(n) is equal to that one of the n 
observed Z/'s such that exactly [nbi] other Xfs are 
below it, where [nbi] denotes the largest integer con- 
tained in nbi. We can ignore the possibility of ties, 
which occur with probability zero. 

We assume that the equation Fi(y) = bi has a unique 
solution in y, which we denote by Ui {i = 1, . . ., A:), and 
thatfi(xi) is continuous and positive at Xi = in. Define 

Z i (n) = VnfAu>)^0f%- 
V 6/(1 — 0/) 

We shall show that as n increases, the joint cumulative 
distribution function of Z\(n), . . ., Zk(n) approaches 
the /r-variate normal cumulative distribution function 
with zero means, unit variances, and the covariance 
between the ith andyth variables (i ^ j) given by 

Fjjjuj, Uj) — bjhj 



y/bibjil-bi)(l-bj) 

This was proved by Mood [2] for the special case 
bi = . . . =6jfc = V2, and by Siddiqui [3] for the case k = 2 
and under the assumption that the first and second 
partial derivatives of F(xi, xi) are continuous at uu ^2 
and the joint probability density function is positive 
there. Siddiqui conjectured that the result holds for 
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general k, and sketched a proof, assuming that the 
partial derivatives of F(x\, . . ., Xk) of order k are con- 
tinuous at Uu ' • •» u k- Both Mood and Siddiqui used 
the joint probability density function of Zi(n), . . ., 
Zk(n), and the resulting computations were lengthy. 
Below we give a simple proof, under less restrictive 
conditions. The proof uses the joint cumulative dis- 
tribution function of Z\{ri), . . ., Zk(n). 

2. Proof of Asymptotic Normality 



Fix a point (zi, . 
Define 



. ,2a) in {x u . . . yXk) — space. 



yi(n) = Ui + 



Zi\Zbi(l-bi) 

ftudVn 



Use the point (yi(ra), . . . ,yk(n)) as the origin of the 
usual system of orthogonal axes in (xi, . . .,%/,) — 
space. These axes define 2 k "octants" in the space. 
We assume that these octants are labeled in some 
definite order, which will be held fixed. For example, 
when k = 2, we have four quadrants, rather than 
"octants," which we assume are labeled in the con- 
ventional way. Let Nj(n) denote the number of the 
n observed /c-dimensional vectors which fall with- 
in the jth octant. Because of the continuity of 
F(xi, . . . ,Xk), we can ignore the possibility that one 
or more of the observed vectors will fall on the bound- 
ary of an octant. The quantities Nj(n) (/= 1, . . . , 2*") 
have a multinomial distribution with parameters n, 
p\(n) , . . .,p 2 k(n), where Pj(n) is the probability 
assigned to the y'th octant by the distribution function 
F{%u • • • » Xk)- Clearly, as n increases pj{n) approaches 
the probability assigned by F(xi, . . . ,Xk) to the 
yth octant determined by axes through the point 
(uw • • >Wfc). We denote this limiting value of 
Pj(n) by pj. 

Let the symbol 2 (l) denote the operation of sum- 

j 

ming over all those values of j such that in the jth 

octant, the ith coordinate is greater than yi(n). There 

are 2 k ~ l such values of j. For example, when k = 2, 
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using the conventional labeling of the quadrants, S (1) 

3 

would sum over 7 = 1, 4, and 2 (2) would sum over 

j 
7=1, 2. Define Lin) as 2 (i Wj(/i), Then the event 

j 

{Zi(ri) < zi} is the same as the event {Zn(ft) < n — [nb\\}. 
Therefore 



P[Z 1 (n)<z u . . . ,Z k (n)<z k ] 
=P[Li(n)<n-[nbil 
Next, we define 

%Mi \ Nj{n)-npj(n) 

Mj{n)=- 



. ,L k (n)< n — [nbk]]. 
(1) 



(J=h 



,2«y 



Vnpjin) 

It is well known that as n increases, the joint distribu- 
tion of Afi(n), . . . , M 2 k(n) approaches a normal 
distribution with zero means, variance of Mj(n) equal 
to (1— pj), an d cov ariance between Mh(n) and Mj(n) 
equal to —vphPj. (See Cramer [l] 3 p. 318.) We 
can write 



Un) = X (i) [n Pj (n) + Vn P j(n) Mj(n)] 



(2) 



Clearly 



V i) np j (n) = n[l-F i (y i (n))] 

J 



l-FiU + 



V6K1-60) 



yfnflui) 

= n{\- bi) - Vn' ZiVbi(l-bi) - n gi(n) 

where vn gi(n) approaches zero as n increases. 
Also, 

n — [nbi] = n(l — bi) + a 



(3) 



(4) 



where |cj| < 1. Substituting (2), (3), and (4) in (1), and 
rearranging terms, we find 
Ptfiin) < zi, . . . , Z k (n) < z k ] 



P 



^VpJUMjin) 



Vbia-bi, 



■<Zi + 



V^igin) 



+ 



Ci 



VnVbjl - h] 



Vb,(l-bi) 
; i = 1, . . . , k 



(5) 



Since pj(n) approaches pj as n increases, and vngt(n) 
and ctjvn both approach zero as n increases, (5) shows 
that the joint asymptotic distribution of Zi(n), . . . , Zk(n) 
is the same as the joint asymptotic distribution of 



(1) r— (k) _ 

2 V^jMj(n) 2 ^PJ M M 



V6i(l-6i) Vb k (l-b k ) 



(6) 



if this latter asymptotic joint distribution is abso- 
lutely continuous, which it is, since it is a nonsingular 
/c-variate normal distribution. Therefore the asymp- 
totic joint distribution of Zi(ri), . . . , Z k (n) is normal, 
with zero means and variances and covariances the 
same as in the asymptotic joint distribution of the vari- 
ables listed in (6). In computing these variances and 
covariances, we can look at just two of the variables 
in (6) at a time, and there is no loss of generality in 
looking at the first two. In doing this, we can assume 
that we are taking n observations on (X\, X 2 ), ignoring 
(X3, . . . , Xk). This reduces the problem to the case 
k = 2, where F\ t 2(^1,^2) is the joint distribution of the 
basic variables, and we have four quadrants. Using 
the conventional labeling of the quadrants, we have 

^V^jMjin) 

J_ Jv^MM + VpMln) 

V&1U-&1) V6i(l-6i) 



(2) -_ 

2 VijMj(n) 



VpiMi(yi) + Vp^MiJn) 



V6 2 (l-fe 2 ) \ / b 2 (l-b 2 ) 

p\ = l — b\ — b 2 +Fi, 2 {ui, u 2 ) 
P2 — bi — F 1)2 (uu u 2 ) 
P4 = b 2 — F U2 (u u u 2 ). 
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Using these facts, and the variances and covariances 
in the joint asymptotic distribution of Mi(n) 9 M 2 (n), 
M 3 (ra), M±{n) given above, a straightforward compu- 
tation shows that the variances in the asymptotic 
distribution of Z\(ri) and Z 2 (n) are equal to unity, and 
the covariance is equal to 

Fi, 2 (u u u 2 ) — bib 2 ( 

VW> 2 (1- 61XI-62)' 

This completes the proof of the theorem. 



3. Extensions 

It is clear that the method above also proves the 
joint asymptotic normality for the case where we 
include several different quantiles for each Xi. In 
this case, we use several sets of axes, giving a collec- 
tion of regions determined by the intersections of 
the octants defined by the various sets of axes. For 
the 7th such region, we define Nj(n) as the number of 
observed vectors falling in it, and proceed as above. 
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